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REQUEST: 

• Summarize the ways that data are being used in schools, districts, and states, and by re- 
searchers to identify students at-risk for not graduating and/or not achieving career and 
college readiness. 


EVIDENCE BASED 
EDUCATION 
REQUEST DESK 


OUR GOAL 

To assist educators and 
policymakers in their 
efforts to apply the 
evidence base to 
decisions about policies, 
programs, and practices 
they encounter. 


RESPONSE 

Evidence-based Education Request: Indicators in Use 

Research led by the Consortium on Chicago Public School Research (University of 
Chicago) and the Center for Social Organization of Schools (Johns Hopkins University), 
has identified specific indicators — students’ academic characteristics — that provide early 
signals that students are on a path toward dropping out of high school. Measured at dif- 
ferent points in time, typically 6-9 th grades, these indicators are used for a variety of pur- 
poses from identifying students in need of intervention to school and district accountabili- 
ty ratings. 

This Evidence-based Education Request summarizes ways that data are being used in 
schools, districts, and states, and by researchers to identify students at risk for not 
graduating and/or not achieving career and college readiness. Searches of Wilson Web, 
EBSCOHost, and the Education Resources Information Center (ERIC) were performed to 
gather this information. 1 To add to our findings, we searched well-known papers on such 
indicators (e.g., Allensworth & Easton, 2007) as well as the websites of reform support 
and education research organizations known to do work in this area. Finally, we 

9 

conducted a Google search in order to identify lesser-known sites using these indicators. 

Information in this chart is meant to be informative to schools, districts, and states inter- 
ested in learning from others who are implementing indicators. The list of places imple- 
menting indicators below is non-exhaustive and does not represent all the ways indica- 
tors can be formulated or implemented. In fact, research suggests that each site should 
undergo its own examination of data, because previously identified indicators (e.g., at- 
tendance rates) are not equally predictive across districts and states. 


1 EBSCOHost, Wilson Web, ERIC were searched using the following terms: “on-track indicator”; “on- 
track indicator”;“early warning system + high school” ;“on-track to graduate.” 

2 Search terms used: “on-track indicators in use in districts” and “on-track to graduation indicators.” Only 
relevant articles in the first 100 results were evaluated (for each search). 


If you have any questions regarding this document, please contact the 
REL-SE, 1-800-755-3277 or RELSoutheast@serve.org 
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It is important to know that although most of the sites below have tested the predictive 
validity of their indicators (testing their relationship to graduation or of career and college 
readiness), some sites have not. Instead they have replicated indicators others have used 
or selected indicators based on their own knowledge and experience. How indicators 
were developed was not always made clear. Also, in some cases, we were unable to 
identify where in the process a state, district, or school was in implementing the use of 
indicators (e.g., research, planning, piloting, rolling out, fully established). We have in- 
cluded any ongoing or planned studies on site-specific indicators that we found to be in- 
clusive in the information we share. 
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Location 

(District/ 

State/ 

School) 

Purpose of using 
Early Warning 
Indicators 

When Indicator is 
“Administered”/ 
Should be Adminis- 
tered 

Variables 

Findings/ More Information 

Source 

Districts 

Anchorage 
School Dis- 
trict 

On-track to gradu- 
ate 

End of ninth grade 

■Earned a minimum of 5.5 
credits by the end of 
freshman year 
■Failed no more than one 
semester of a core subject 

Unclear if there is evidence that these indicators are pre- 
dictive of graduation rates in ASD. Also unclear how 
widely or often these on-track indicators are used. 

Anchorage School District, (n.d.). On- 
going overall goals 2008-2009. Re- 
trieved April 13, 2009, from 
http://www.asdkl2.org/school_board/ 
goals. asp 

Baltimore 
City Public 
Schools 

Identify students 
who are off-track 
throughout the edu- 
cational pipeline 

Not applicable: 
Planned research on 
on-track at multiple 
grade-levels 

In progress 

The Baltimore Education Research Consortium is conduct- 
ing several projects related to on-track using BCPS data: 
Keeping On-track after First Grade Success; Keeping On- 
track in the Middle Grades; Keeping On-track in Ninth 
Grade and Beyond; and Understanding the Process of 
Dropping Out. 

Baltimore Education Research Con- 
sortium. (n.d.). On track and on time: 
Baltimore Education Research Con- 
sortium core analytic projects July 
2008- June 2011. Retrieved April 6, 
2009, from http://baltimore- 
berc.org/pdfs/On_Track_and_On_Tim 
e.pdf 

This is an explora- 
tory study, examin- 
ing the pathways 
followed by stu- 
dents enrolled in 

Not applicable 

■Repeating grades in mid- 
dle school 

■Repeating grade nine 
■High rates of school mo- 
bility 

■Absenteeism 3 

■Only one-third of the cohort examined graduated from 
BCPS on time. Another 20 percent may have graduated 
on time in their transfer school district. 4 

■The following factors were related to dropout: being held 
back in middle school or ninth grade, high rates of school 
mobility, and to some extent, absenteeism. Absenteeism 

Maclver, M.A., Durham, R.E., Plank, 
S.B., Farley-Ripple, and Balfanz, R. 
(2008). The challenge of on-time ar- 
rival: The seven-year flight paths of 
Baltimore ’s sixth grades of 1999- 


3 There was not a perfect correlation between absences and graduation. Students in the chronically absent group actually graduated at higher rates than students in the never chronically absent group. The authors sug- 
gest that some students are able to “slide by,” continuing normal progress toward graduation, despite missing multiple classes throughout the year. Students who were severely chronically absent graduated at much 
lower rates than students in the other categories. Students considered chronically absent missed at least one -ninth of the school year. Students labeled severely chronically absent missed at least two-ninths of the 
school year. 

4 This is if all students who had a documented transfer were to graduate. 
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Location 

(District/ 

State/ 

School) 

Purpose of using 
Early Warning 
Indicators 

When Indicator is 
“Administered”/ 
Should be Adminis- 
tered 

Variables 

Findings/ More Information 

Source 

Districts 


sixth grade during 
1999-2000 in Bal- 
timore City Public 
Schools. 



alone did not appear to inhibit on-time graduation — in 
fact, students that were chronically absent were more 
likely to graduate on time than students who were not 
chronically absent — but may have contributed to other 
factors that led to dropout. 

2000. Baltimore, MD: Baltimore Edu- 
cation Research Commission. 

Boston Public 
Schools (MA) 

Researchers identi- 
fied categories of 
“dropouts” 

9th grade 

■ Multiple ninth-grade 
course failures (first time 
ninth graders who fail one 
or more course in English, 
math, science, or history) 

■ One or more eighth grade 
risk factors (attendance 
below 80 percent, two or 
more years over-age, fail- 
ing multiple courses) 

■ Late entrance English lan- 
guage learners 

■ Special education students 
taught in removed envi- 
ronment 

The Pantheon Group found that 75 percent of dropouts 
from BPS fit into one of the follow categories: failed mul- 
tiple courses in the ninth-grade; had one or more eighth 
grade risk factors; were late entrance ELL students; or 
were special education students taught in a removed envi- 
ronment . 

Pinkus, L. (2008). Using early- 
warning data to improve graduation 
rates: Closing cracks in the education 
system. Washington DC: Alliance for 
Excellent Education. 

Pantheon Group, The. (2007). Strateg- 
ic planning to serve off-track youth: 
Data review and strategic implica- 
tions. Retrieved April 3, 2009, from 
http://www.ytfg.org/mpgresources/BP 
SStratPlanStudy.pdf 
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School) 
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Early Warning 
Indicators 

When Indicator is 
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tered 

Variables 

Findings/ More Information 

Source 

Districts 

Chicago Pub- 
lic Schools 
(IL) 

Used to predict stu- 
dents who will 
graduate from high 
school in four years 

Used to produce 
reports for individ- 
ual schools in CPS 
(see Miller, Lup- 
pescu, & Correa, 
2003 for example). 

End of ninth grade 

■No more than one seme- 
ster F in a core subject 
■Accumulation of five full 
course credits 

■“Students who are on- track at the end of their freshman 
year [have accumulated five full course credits and re- 
ceived no more than one semester F in a core subject] are 
more than three and one-half times more likely to gradu- 
ate in four years than off-track students” (Allensworth & 
Easton, 2005). 

■The on-track indicator could be refined by using pass 
rates rather than number of semester Fs (Allensworth & 
Easton, 2005). 

Miller, S.R., Luppescu, S., & Correa, 
M. (2003). How well do Vivaldi stu- 
dents succeed after elementary 
school? Chicago, IL: Consortium on 
Chicago School Research. Retrieved 
March 30, 2009, from 
http://www.eric.ed.gov/ERICDocs/dat 
a/ericdocs2sql/content_storage_01/00 
000 1 9b/80/3a/ed/ac .pdf 

Allensworth, E.M., & Easton, J.Q. 
(2005). The on-track indicator as a 
predictor of high school graduation. 
Chicago, IL: Consortium on Chicago 
School Research. 

Johnson, E. (2008). REA fact sheet on 
the CPS Freshman on-track gradua- 
tion rate. Chicago, IL: Department of 
Applied Research, Chicago Public 
Schools. 

Used to predict 
whether students 

End of ninth grade 

■ GPA 

■ On-track vs. Off-Track 

■The following freshman-year indicators have an overall 
correct prediction rate of 80 percent: GPA (predict 73% 

Allensworth, E.M., & Easton, J.Q. 
(2007). What matters for staying on- 
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are on-track to 
graduate 


■ Semester course failures 
■Absences 

of nongraduates, 85% of graduates), the off-track/on- 
track indicator (predict 72% of nongraduates, 85% of 
graduates), and semester course failures (predict 66% of 
nongraduates, 89% of graduates). 

■ "Student absences" has overall correct prediction rate of 
77 percent (predict 59% of nongraduates, 90% of gra- 
duates). 

■Fall-semester failures and fall-semester absences are 
both highly predictive of whether or not a student will 
graduate within four years. With information on fall- 
semester failures only, it is possible to predict 55 percent 
of nongraduates and 91 percent of graduates. With in- 
formation on fall-semester absences only, it is possible to 
predict 53 percent of nongraduates and 89 percent of 
graduates. 

■When information about student background and prior 
achievement is added to information on students’ ninth- 
grade Fs or GPAs, it improves the prediction by only 
about half a percentage point (to 80.5%). 

track and graduating in Chicago Pub- 
lic High Schools: A close look at 
course grades, failures, and atten- 
dance in the freshman year. Chicago, 
IF: Consortium on Chicago School 
Research. 

Dallas Inde- 
pendent 
School Dis- 
trict (TX) 

Identify students 
off-track for gradu- 
ation 

End of ninth grade 

■No more than one seme- 
ster F in a core subject 
■Accumulation of five full 
course credits 

■Author ran on-track indicator model using two sets of va- 
riables: 1) no more than one semester F in a core subject, 
accumulation of five full course credits (used in CPS 
study), and 2) no more than one semester F in a core sub- 
ject, accumulation of six full course credits (reflects Dal- 
las’s requirements for student promotion). The author 

Weir, D. (2008). Development of the 
Dallas ISD on-track indicator, 2007- 
08. Retrieved March 30, 2009, from 
http://www.dallasisd.org/eval/evaluati 
on/atglance2009/EA08 - 153 -4- At-a- 
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found that the first set of variables was slightly more 
predictive than the second (81% vs. 80%). 

■Author found that a student’s grades during the first six 
weeks of freshman year are highly predictive of his or 
her on-track status at the end of freshman year. If a stu- 
dent has an F in the first six weeks on a course, he or she 
is likely to fail the course (75 percent chance), and thus, 
likely to be off-track to graduation: “While 77% of stu- 
dents who had no core course failures in the first six 
weeks were on-track at the end of the year, only 36% of 
those who failed one core course were on-track, and 11% 
of those who had two failures in the first six weeks were 
on-track.” 

Glance- On-T rack- Indie ator.pdf 

Identify students 
off-track for gradu- 
ation 

Elementary, middle, 
and high school 

On-line dashboards track 
how well students are meet- 
ing expectations, discipline 
referrals, student absences, 
classroom achievement, and 
so forth and help teachers 
and principals monitor stu- 
dent progress and identify 
students before they fall off- 
track. 

Dashboards have been implemented at 12 high schools, 
seven middle schools, and two elementary schools. In 
2010-2011, dashboards are expected to expand district- 
wide. 

Michael & Susan Dell Foundation. 
(2009). Michael & Susan Dell Foun- 
dation applauds Gates Foundation 
investment in improving student 
achievement in Dallas schools. Re- 
trieved April 13, 2009, from 
http://www.msdf.org/News_and_Reso 
urces/MSDF_Press_Releases_Article_ 
Mi- 

chael Susan Dell Foundation Appl 
auds_Gate s_Foundation_Inve stment_i 
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Campus scorecards provide 
an annual assessment of 
school performance and 
progress towards student 
achievement goals. One indi- 
cator tracked is the on-track 
to graduation rate. 

Sample middle school on- 
track indicators: 

■Attend 90 percent of 
classes of more 
■ Score 2100 or higher on 
all TAKS tests and receive 
no more than one semester 
“F” in a core subject 


n_Improving_Student_Achievement_i 

n_Dallas_Schools.aspx 

For example of Dallas ISD middle 
school scorecard, see 
http://www.dallasisd.Org/scorecards/p 
dfcards/05 8E_SPENCE.pdf 

Fall River 
(MA) 

Identify future 
drop-outs 

End of fourth grade 

■C- academic GPA 
■Twenty-fifth percentile of 
class 

“Early dropouts” (students that drop out of school between 
seventh and ninth grade) can be identified as early as the 
fourth grade. In general, future early dropouts had a C- av- 
erage and ranked in the twenty-fifth percentile (Roderick, 
1993. In Pinkus, 2008). 

Pinkus, L. (2008). Using early- 
warning data to improve graduation 
rates: Closing cracks in the education 
system. Washington DC: Alliance for 
Excellent Education. 

Los Angeles 

Los Angeles has the 

Throughout middle 

High school at-risk indica- 

■High school at-risk list calculates students’ “risk degree.” 

Lim, C., & Pirone, J. (n.d.). Using da- 


w 

REL 


How is Data Being Used in Identifying At-Risk Students 


Location 

(District/ 

State/ 

School) 

Purpose of using 
Early Warning 
Indicators 

When Indicator is 
“Administered”/ 
Should be Adminis- 
tered 

Variables 

Findings/ More Information 

Source 

Districts 

Unified 
School Dis- 
trict (CA) 

following systems 
in place to identify 
at-risk student: 
■At-risk lists de- 
veloped for the 
Dropout Preven- 
tion Office 
■Early alert sys- 
tem 

■Potential dropout 
lists 

school and high school 

tors: 

■Age minus grade index 
■Attendance rate 
■Cumulative GPA 
■Number of “unsatisfacto- 
ry” marks in work effort 
■Number of Fs on 
Achievement Marks 

Middle school at risk indica- 
tors: 

■Far Below Basic in CST 
in EFA or math 
■Two or more Fs in last 
semester 

■Cumulative GPA below 
1.5 

■Far Below Basic in EFA 
or Math Periodic Assess- 
ment (most recent) 
■Attendance rate below 
90% 

■ One or more suspensions 

■Middle school at-risk list can be sorted by number of 
student risk factors. 

■Early alert system identifies students who have had de- 
clines in performance (CST English/Fanguage Arts, calc, 
yearly; CST Mathematics, yearly; Attendance, monthly; 
Mathematics assessment, quarterly; Fanguage Arts as- 
sessment, quarterly; GPA, grading period; work habits, 
grading period). 

■LAUSD also maintains of “potential dropouts” (split into 
three categories: potential leaver dropouts, potential no 
show dropouts, potential no show matriculating dro- 
pouts). 

ta for dropout prevention: Can we 
identify at risk students before it’s too 
late? PowerPoint. Retrieved April 14, 
2009, from 

http://www.myfuturemydecisi 0 n. 0 rg /0 

urpag- 

es/auto/2008/5/ 1 / 1 209652805 63 8/Dat 
a%20Driven%20Decision%20Making 
.ppt#l 

Philadelphia 

Identify future 

Sixth grade 

■A final grade of F in ma- 
thematics 

■ Sixth grade students who display even one “signal” iden- 
tified by the authors (attend class less than 80 percent of 

Neild, R., Balfanz, R., & Herzog, F. 
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(PA) 

drop-outs and pro- 
vide tiered inter- 
ventions in an effort 
to prevent students 
from exiting the 
system. 


■A final grade of F in Eng- 
lish 

■Attendance below 80 per- 
cent 

■A final “unsatisfactory 
behavior” mark in one or 
more classes 

the time, receive a final course grade of F in mathematics 
or English, or who receive an “unsatisfactory behavior” 
mark at the end of one or more courses) are likely to 
drop out of high school. 

■By the end of freshman year, 80 percent of eventual dro- 
pouts will have shown one or more of these “red flags.” 

■Ninth graders that earned fewer than two credits or had 
an attendance rate of 70 percent or lower, had more than 
a 75 percent chance of dropping out of school. 

(2007). An early warning system. 
Educational Leadership, 65(2), 28-33. 

Neild, R., & Balfanz, R. (2006). Un- 
fulfilled promise: The dimensions and 
characteristics of Philadelphia ’s dro- 
pout crisis, 2000-2005. Philadelphia, 
PA: Philadelphia Youth Network, The 
Johns Hopkins University, and the 
University of Pennsylvania. 

Portland (OR) 

Identify students at- 
risk for failing to 
graduate; determin- 
ing when students 
are most likely to 
disengage from 
school (year and 
quarter) 

Authors used multiva- 
riate, longitudinal co- 
hort analysis to look at 
the progress of every 
student in the graduat- 
ing Class of 2004 and 
identify markers that 
students were at-risk of 
not graduating. 

■Whether or not students 
met state standards in 8th 
grade 

■Year and time of year 
■Failing one or more 
courses during freshman 
year 

■Having insufficient credits 
■Nonconventional entry 
(didn’t start at school in 
9th grade and stay at 
school throughout dura- 
tion of high school) 

■There are certain times when students are more likely to 
disengage (summer and end of 12th grade). 

■Using more than one indicator increases ability to predict 
whether or not student will fail to graduate. 

■“The risk of leaving school without graduating is 6 times 
higher for students who are over- age, repeat grades, enter 
after 10th grade, and transfer inside/ outside the district 
than for those who follow the conventional pattern of 
high school attendance.” 

■Transferring within district, increased student’s likelih- 
ood of graduating, suggesting students may have been 
able to find a program which was a better fit. 

Cielo, M.B., & Leveen, L. (2007). The 
fourth R: New research shows which 
academic indicators are the best pre- 
dictors of high school graduation — 
and what interventions can help more 
kids graduate. Portland, OR: Con- 
nected by 25. Retrieved April 3, 2009, 
from 

http://www.connectedby25.org/resour 
ces / 

Prince 

Prince George’s 

■ Freshman Watchlist 

■ Watchlist : 

■Research has suggested that graduation rates at PGCPS 

Prince George’s County Public 


REL 


SOUTHEAST 


How is Data Being Used in Identifying At-Risk Students 


10 


Location 

(District/ 

State/ 
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Should be Adminis- 
tered 

Variables 

Findings/ More Information 

Source 

Districts 

George’s 
County Public 
Schools (MD) 

County Public 
Schools is rolling 
out an early warn- 
ing system to iden- 
tify at-risk students 

Report (for use dur- 
ing summer and 
Quarter) 1): Lists in- 
coming ninth graders 
with risk factors (in- 
cludes information 
on 8 th grade atten- 
dance, grade data, 
age, MSA scores, 
subgroup informa- 
tion, and feeder 
school) 

■ Freshman Success 
Report (for use dur- 
ing Quarters 2, 3, 
and 4): includes “on- 
going information on 
current freshman”; 
released quarterly, 
and can be used to 
track student risk 
factors related to at- 
tendance and course 
grades 

1 . Student has more than 
nine absences in eighth 
grade 

2. Student has a D or lower 
as a final grade in eighth 
grade course 

■ Freshman Success Report: 

1 . Student has more than 
two absences in the last 
quarter 

2. Student has a D or lower 
according to the last quar- 
terly report card 

are less sensitive to attendance rates (compared to the li- 
terature). 

Schools, (n.d.). Performance man- 
agement and early warning reports: 
Supporting transitions for high school 
students. Retrieved April 6, 2009, 
from 

http://www.boarddocs.com/mabe/pgcp 
s/Board. nsf/7f0976c2db29 1 9ff872573 
280068 Ia69/8a729ec367fdd50987257 
5700078308a/$FILE/Early%20Warni 
ng%20and%20HSA%20Update.pdf 

Richmond 

RCS uses the RHS 

daily 

Some measures used by the 

According to Richmond Community Schools’ website, the 

Find more information at: 
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Community 

Schools 

(Richmond, 

IN) 

Graduation Pipeline 
to generate a daily 
graduation metric 
for the district; the 
tool also allows 
administrators to 
monitor risk indica- 
tors for students 


RHS Graduation Pipeline 
tool: 

■ GQE pass or fail 
■Credit thresholds 
■Information on transfers 
■IEP that leads to Certifi- 
cate of Completion 
■Dropout data 

district will share its tool with interested parties. 

http://www.rcs.kl2.in.us/district/kpi/R 
HS/pipelinemetric s . asp 

States 

Kentucky 

Use students’ high 
school data, plus 
data from first few 
years of college to 
determine if student 
is at-risk of drop- 
ping out from col- 
lege 


In progress 

This study is in progress. 

Study is being conducted by the Eve- 
ryone Graduates Center and Jobs for 
the Future. See 

http://www.everylgraduates.org/about 
.html for more information 

Louisiana 

Identify at-risk stu- 
dents in order to 
provide them with 
interventions 

Unknown 

■ Student attendance 

■ Student course achieve- 
ment 

■ Student behavior 

■ Student age 

■Louisiana contracted with a regional software vendor to 
buy a pre-made early warning module. Louisiana is using 
data collected from the schools to verify and strengthen 
the accuracy of the indicators. 

■School and district leaders receive twice-monthly reports 
on data. 

Pinkus, L. (2008). Using early- 
warning data to improve graduation 
rates: Closing cracks in the education 
system. Washington DC: Alliance for 
Excellent Education. 
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Massachusetts 

Massachusetts has 
considered creating 
a college- and 
work-ready indic- 
tor, as well as de- 
veloping an early 
warning system to 
help districts and 
states identify stu- 
dents at-risk of 
dropping out. 

Unknown 

Possible indicators of being 
ready for college and work: 
■Completing the Mas sCore 
■Earning a Certificate of 
Mastery or of Occupation- 
al Proficiency 
■Participating in AP or IB 
courses and earning min- 
imum scores or above 
■Earning college credits 
while enrolled in high 
school 

Possible indicators of stu- 
dents at-risk for dropping 
out: recommended that 
Board of Education analyze 
state level data to find best 
indicators (i.e., look at atten- 
dance in middle school, re- 
tention in middle school, 
first- time ninth graders : off- 
track” to promotion to the 
10 th grade, 9 th grade repea- 
ters, students who are over- 


Jobs for the Future & Achieve, Inc. 
(2007). High standards and gradua- 
tion rates: Moving forward on a dual 
agenda in Massachusetts. Retrieved 
April 13, 2009, from 
https://www.policyarchive.org/bitstrea 
m/handle/10207/8661/DualAgendain 
Mass .pdf? sequence= 1 
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age for grade) 



Texas 

Identify students 
on-track to graduate 

Unknown 

The following are suggested 
measures for evaluating stu- 
dent progress toward gradua- 
tion— as a whole — not as in- 
dividuals. Whether or not 
these on-track indicators are 
directly predictive of student 
graduation rates is not estab- 
lished in this report. 

■Percent passing Grade 8 
All TAAS tests (for all 
students and by groups of 
students) 

■Percent passing Grade 8 
TAAS by subject (for all 
students and by groups of 
students) 

Texas has produced a document entitled “How to use the 
2003 Early Indicator Reports.” How many and what dis- 
tricts are using early indicators is not described in this re- 
port. The purpose of the report is to infonn: “This docu- 
ment uses results from the state 2003 Early Indicator Re- 
port, Part I, to illustrate analyses that educators may wish 
to reproduce with local results. In each case, an example 
expectation is defined and then evaluated. These example 
expectations are for illustration only; they are not accoun- 
tability rating standards. As these early indicator reports 
are designed to focus on preparing students to meet the 
new exit-level testing requirement, the ultimate goal is for 
all students to be eligible to graduate.” 

Texas Education Agency. (2001). 

How to use the 2003 Early Indicator 
Report. Retrieved April 13, 2009, 
from 

http ://ritter. tea. state .tx .us/taa/perfrepor 
t010309how.doc 
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■Cumulative end-of-course 
performance (for all stu- 
dents and by student 
groups) 

■Pass rates of end-of- 
course examinations by 
subject (for all students 
and by student groups) 

■ Graduation rate of Class 
of 1999 



Schools 

Abbeville 
High School 
(LA) 

Used to identify 
students who are at- 
risk and provide 
them with needed 
supports 

Ninth grade 

■Discipline records 
■Attendance records 
■ Overall GPA 
■Decline in GPA 

At-risk student are identified every three weeks using indi- 
cators and provided with interventions. Students remaining 
at-risk receive progressively stronger interventions. When 
used with the freshman academy, this system of identify- 
ing and supporting at-risk students decreased the number 
of ninth graders who were not promoted to the tenth grade 
by 50 percent. 

Pinkus, L. (2008). Using early- 
warning data to improve graduation 
rates: Closing cracks in the education 
system. Washington DC: Alliance for 
Excellent Education. 

Chief Sealth, 
Franklin, and 
West Seattle 
(Seattle, WA) 

To identify stu- 
dents at-risk of 
dropping out in 
three Seattle 
schools receiving 
money through the 

Ninth grade 

■ Failure to meet standard 
on 8 th -grade state assess- 
ments 

■An ‘F’ in math or English 
in middle school 
■An ‘F’ in any course in 9 th 

■On October 27, 2008, District Superintendent Maria 
Goodloe-Johnson sent a letter to High School Instruc- 
tional Director Michael Tolley describing the High 
School Academic Achievement Program and asking for 
its approval. The High School Academic Achievement 
Program was designed to improve graduation rates in 

Goodloe-Johnson, M. (2008). School 
Board Action Report. Seattle, WA: 
Seattle Public Schools. Retrieved 
April 13, 2009, from 
http://www.seattleschools. 
org/area/board/08-09agendas/l 1 1208 
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High School Aca- 
demic Achievement 
Program - Families 
& Education Levy 


grade 

■Falling behind in required 
credits for graduation 
■ Suspension or expulsion 
■Absenteeism rate of 10% 
or higher 

■Failure to be promoted to 
10 th grade 

three Seattle schools, using interventions and data- 
tracking. 

■The indictors were gathered from studies of early warn- 
ing systems in Portland, Chicago, and Philadelphia, as 
well as several guides to building early warning systems, 
dropout prevention, etc. 

agenda/felhighreport .pdf 

Feltonville 
School of Arts 
and Sciences 
and the Upper 
School of 
Cooke Ele- 
mentary 
(Philadelphia, 
PA) 

Used to identify at- 
risk students and 
provide them with 
supports as part of 
the pilot-program, 
Keeping Middle 
Grades Students 
On-Track to Grad- 
uation: the Early 
Warning Indicators 
Project. 


■Poor attendance 
■Behavior problems 
■F in English 
■F in Math 

■ Staff can track students’ early warning indicators using 
an online tool. 

■Students identified as at-risk are met with varying levels 
of interventions. 

■City Year Corp members have been instrumental in help- 
ing monitor attendance, tutoring, instructing small 
groups, mentoring, and serving as positive role models. 

■EWI costs about $150,000 to $400,000 a year, depending 
on school size and level of implementation. 

■Fifty-four percent of the 250 students who were “off- 
track” to graduation at the beginning of the 2008-09 
school year at FSAS have shown improvement in their 
risk-area, while two-thirds of students have improved 
their math and English grades. 

Herzog, L. (2009). Two schools use 
‘early warning’ system to avoid dro- 
pouts. Focus On Keeping Students On 
Track. Retrieved April 2, 2009, from 
http://www.thenotebook.org/spring- 
2009/09 1 09 1/two-schools-use- 
%E2%80%98early- 
warning%E2%80%99-system-avert- 
dropouts 

Jenks High 
School (Jenks 

Identify whether or 
not student will 

End of eighth grade 

Indicators that student is 
likely to fail ninth grade 


Reeves, D. (2007). Teachers step up. 
Educational Leadership, (55(1), 87-88. 
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Public 
Schools in 
OK) 

pass courses. 
Teachers intervene 
before student fails 
course. 


math: 

■D in English or math in 
8th grade 

■Failure on a criterion- 
referenced reading or math 
test 



New Visions 
for Public 
Schools (New 
York City, 
NY) 

Information used to 
produce schoolwide 
reports on student 
progress and to 
produce individual- 
level reports to 
share with students 
and parents 

High school students 

■Course credits 
■Pass grades in end-of- 
course Regents exams 
■ Other indicators for col- 
lege readiness 


Pinkus, L. (2008). Using early- 
warning data to improve graduation 
rates: Closing cracks in the education 
system. Washington DC: Alliance for 
Excellent Education. 

Middle school students 

In progress 


Pinkus, L. (2008). Using early- 
warning data to improve graduation 
rates: Closing cracks in the education 
system. Washington DC: Alliance for 
Excellent Education. 

T.C. Williams 
High School 
(Alexandria, 
VA) 

The school aims for 
each student to 
have a Lexile Score 
of 1300 or higher 
by twelfth grade. 
This score has been 
identified by the 

Students’ are assessed 
from sixth grade on. 

■Lexile score 

With interventions, students are passing state reading test 
on second try. 

Pinkus, L. (2008). Using early- 
warning data to improve graduation 
rates: Closing cracks in the education 
system. Washington DC: Alliance for 
Excellent Education. 
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school as a proxy 
for work and col- 
lege readiness. Stu- 
dents who do not 
meet grade-level 
markers receive 
additional supports. 





National 

Members of 
the 2005 and 
2006 high 
school gra- 
duating 
classes; only 
students who 
had taken the 
EXPLORE, 
PLAN, and 
ACT 

Identify whether 
students are on- 
track for career and 
college readiness 

End of eighth grade 

■ Student’s eighth grade- 
achievement, as measured 
by EXPLORE scores 

■The authors found that students’ eighth grade achieve- 
ment (EXPLORE test scores) is a better predictor of col- 
lege and career readiness than student background cha- 
racteristics, standard coursework, advanced/honors 
coursework, high school GPA, and student testing beha- 
viors. 

■The authors examined which of the following have the 
greatest impact on student career and college readiness: 
maintaining a B average, earning higher grades, taking a 
core curriculum, taking additional standard courses, tak- 
ing advanced or honors courses, meeting EXPLORE 
College Readiness Benchmarks, and increasing EX- 
PLORE scores 2 points. They found that increasing EX- 
PLORE scores 2 points has the greatest impact on stu- 
dent career and college readiness. 

■The authors measure career and college readiness using 

ACT. (2008). The forgotten middle: 
Ensuring that all students are on tar- 
get for college and career readiness 
before high school. Retrieved April 
10, 2009, from 

http://www.act.org/research/policyma 

kers/pdf/ForgottenMiddle.pdf 
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student performance on the ACT in grade 1 1 or 12. Note: 
Because the EXPLORE and ACT are aligned, it makes 
intuitive sense that students who perform better on the 
EXPLORE might also perform better on the ACT later 
on in their educational career. Had another measure of 
career and college readiness been used instead of ACT, 
results may have been different. 
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We provide research based information on 
educational initiatives happening nationally and 
regionally. The EBE Request Desk is currently taking 
requests for: 

- Research on a particular topic 

- Information on the evidence base for curriculum 
interventions or 

professional development programs 

- Information on large, sponsored research projects 

- Information on southeastern state policies and 
programs 

For more information or to make a request, contact: 
Karla Lewis 
1.800.755.3277 
klewis@serve.org 


The Regional Educational Laboratory (REL) - Southeast's Evidence Based Education (EBE) Request Desk is a service provided by a 
collaborative of the REL program, funded by the U.S. Department of Education's Institute of Education Sciences (IES). This response 
was prepared under a contract with IES, Contract ED-06-CO-0028, by REL-Southeast administered by the SERVE Center at the 
University of North Carolina at Greensboro. The content of the response does not necessarily reflect the views or policies of IES or the 
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